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ABSTRACT 



The disclosed watermarking method utilizes a transform 
technique for inserting an imperceptible digital watermark 
into digital data that is strongly resistant to unauthorized 
detection and decoding. Methods for embedding a water- 
mark that is sufiSciently robust to lossy compression and 
other image processing operations such as reseating are also 
provided. The watermarking principle is based on wavelet 
transforms where the coefficients of the filters have binary 
values, and are thus very attractive for practical realization. 
The wavelet filters utihze complimentary polynomials and 
implement non-regular wavelet transforms upon which the 
digital watermark is inserted. Following the mverse trans- 
formation process, the digital watermark is spread across 
multiple frequencies of the original digital data thereby 
reducing the impact of signal processing operations such as 
compression or other frequency filtering based operations. 
Additional embodiments employing compHmentary matrix 
polynomials which are closely related to multifilter banks 
are also provided. 

23 Claims, 6 Drawing Sheets 
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METHOD AND APPARATUS FOR WAVELET- ods. While it is possible to employ techniques such as those 

BASED DIGITAL WATERMARKING the least significant bits (LSBs) of the image data to 

conceal or embed the digital watermark, such approaches are 

BACKGROUND OF THE INVENTION obviously not sufficiently robust for enduring lossy com- 

5 pression processes as lossy compression techniques tend to 
1. The Field of the Invention randomize the LSBs. Furthermore, employing the most 
The present invention generally relates to the field of significant bits of the data image renders the digital water- 
digital imaging of multimedia data. More particularly, the mark perceptible and therefore unacceptable or undesirable 
invention relates to embedding a sufi&dently robust water- for aesthetically demanding forms of digital data, 
mark into the image data that can withstand lossy compres- Additionally, employing a frequency transformation fol- 
sion schemes without degrading the digital watermark. lowed by embedding the digital watermark in the high 
2 Present State of the Art frequency bands is also insufficiently robust since elemen- 
_ . ^ , , J tary lowpass filtering results in the decimation of the digital 
The nnmber of applications that use digital storage and ^^^^^^^^ Conversely, placmg the digital watermark in the 
transmission is mcreasmg at a rapid rate Specifically, types frequency components causes the digital watermark to 
of digital data mdude digital audio digital images and 15 ^^^^^^ perceptible and therefore aesthetically unaccept- 
digital video which may be largely electromcally distrib- ^^^^ n^erefore, it should be apparent that the objectives of 
uted over ubiquitous pubkc networks such as cable and ^ imperceptible digital watermark that is addition- 
telephone infrastructures^ Additiondly digU^ sufficiently robust to lossy image processing, e.g„ 
physically exchanged and rephcated into exact duphcates of ^ ^^^p^^^.^^^ ,,3^^^^ ^ direct conflict. TTiat is to 
the onginal. ^^^^ ^ digital watermark is sufficiently robust to lossy 
Theproliferalionofdigitalmedia, e.g., audio, image and imaging processing operations, the digital watermark 
video, creates property concerns relating to intellectual becomes perceptually significant and therefore unaccept- 
property rights, e.g., copyrights. Traditional cryptographic ^51^ Conversely, embedding the digital watermark so as to 
techniques have provided one level of protection by allow- ^ 5^ imperceptible results in an inadequately robust digital 
ing decryption of the encrypted data to be performed only by watermark. 

decryption key holders. However, conventional cryptogra- ^ ^^^^ ^^^^ orthogonal transforms e.g., Discreet 
phy provides Uttle protection against data piracy, i.e., unau- ^^^^^ Transform (OCT) and Discreet Fourier Transform 
thorized reproduction of decrypted digital data, since ^j^p^^ perform digital watermarking in the 
decrypted digital data may be easily replicated and distrib- transform domain as taught in Cox et al.. Secure Spread 
uted. Such schemes provide insufficient protection against Spectrum Watermarking for Images, Audio and Video, Pro- 
unauthorized reproduction of information and the mability ceedings of the 1996 International Conference on Image 
to determine the source or origin of unauthorized duplicates. Processing, Vol. Ill, pp. 243-246, 1996. In that particular 

It is known in the prior art to provide a "digital water- public description, the authors propose inserting a water- 
mark" on a document to address this problem. Traditional mark into the spectral components of the digital data using 
digital watermarks on a data file or document may be techniques analogous to spread spectrum communications, 
perceptible and even visible or may be sufficiently embed- i^^^ hiding a narrow band signal in a wide band channel 
, ded within the digital data so as to be imperceptible to those which is represented by the digital data. However, in such 
perceiving the digital data. Such digital watermarks remain DCT-based approaches, spectral energy is concentrated 
present within the data even after processing such as a which facilitates data compression, but becomes disastrous 
decryption procedure. While visible or humanly perceivable for retaining the integrity of the digital watermark, 
digital watermarks may provide apparent identification of such DCT-based approaches, the low-frequency com- 
the incorporating entity, such as a copyright owner, notice- ponents are employed, but the mean-value coefficient is 
able digital watermarks are considered unacceptable for excluded. Such an implementation suggests that the DCT- 
aesthetically integrous media, e.g., imaging and audio data. ^ased approaches are not systematic. Such approaches were 

Imperceptible watermarks arc comprised of an identifi- studied and proposed by Cox et al. due to the popularity of 

cation code that is permanently embedded within the digital DCT in the industry. Therefore, orthogonal transforms such 

data and may contain specific information such as the as the DCT or the DFT are good choices for compression, 

identity of the purchaser of a particular copy of the digital but are less than desirable choices for digital watermarking, 
data, e.g., audio (speech and music), images (photographic 50 The fundamental disadvantage of such techniques result 

and graphics) and video (movies). from the fact that such techniques offer energy compaction 

There are techniques that have been proposed for water- and are therefore not sufficiently adequate choices for a 

marking digital data. In U.S. Pat. No. 5,464,997 to Barton, spread spectrum-based algorithm. 

a method and apparatus is disclosed for basic authentication Thus, it appears that there exists no digital watermarking 
of a digital block such as an image carrying authentication 55 scheme that is capable of embedding an adequately imper- 

information provided by the user embedded into the digital ceptible digital watermark into a digital data file, wherein the 

block of data. A digital signature comprised of a reduced digital watermark is sufficiently robust to withstand lossy 

representation of the digitd block of data is embedded by image processing operations (e.g., compression and 

replacing predetermined bits within the digital block of data. resealing), while remaining detectable following such deg- 
Thc authentication process is performed in reverse order so 60 radation processing. There also does not exist any digital 

as to expose the embedded digital signature, thereby authen- watermarking technique that is sufficiently strongly resistant 

ticating the integrity of the digital block of data. It should be to unauthorized detection and decoding, even by individuals 

pointed out that such an implementation while adequate for cognizant of the present watermarking techniques. Finally, 

digital data transmission and storage techniques that do not there exists no digital watermarking technique that may be 
impose compression techniques, are wholly inoperative in 65 applied to all media types, e.g., audio, images, video, 

modem communication channels that employ sophisticated graphics and text (when represented as an image), that may 

modulation techniques and other lossy compression meth- be universally applied. 
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SUMMARY AND OBJECTS OF THE 
INVENTION 

It is an object of the invention to provide a method for 
watermarking digital data in such a manner as to cause the 
digital watermark to remain resilient throughout lossy com- 
pression processes. 

It is a further object of the present invention to provide a 
method for designating and determining the origin of digital 
data which may be subjected to lossy compression tech- 
niques through the use of a digital watermark. 

It is a further object of the present invention to provide a 
method for spreading a digital watermark across digital data 
such that when a portion of the frequencies of the digital data 
are compressed and thereby disposed, the digital watermark 
remains intact and discemable. 

Yet another object of the present invention is to provide a 
method for determining the origin of a particular copy of 
digital data through the use of a digital watermark 
adequately embedded within the digital data such that lossy 
compression techniques do not obscure or degenerate the 
digital watermark. 

It is yet another object of the present invention to provide 
a method for determining the legitimacy of a copy of digital 
data which has a digital watermark embedded thereon. 

It is yet another object of the present invention to provide 
a digital watermark that is imperceptible when embedded 
within digital data and is thereby aesthetically acceptable for 
marking digital data, such as images, that dictate impercep- 
tible steganography or embedding of data such as a digital 
watermark. 

It is a further advantage of the present invention to 
provide a digital watermarking technique that is strongly 
resistant to unauthorized detection and decoding even to 
those familiar with the watermarking technique of the 
present invention. 

Yet another advantage of the present invention permits 
graceful degradation, such as lossy compression, of the 
digital data having the watermark embedded thereon while 
retaining the integrity of the watermark following a decom- 
pression process. 

It is yet another advantage of the present invention to 
provide a universal watermark that can be applied to a 
myriad of media types, (e.g., audio, images, video, graphics 
and text when represented as an image), while being imple- 
mented in a practical and efiBcient implementation that is 
conducive to computerized processing. 

Additional objects and advantages of the invention will be 
set forth in the description which follows, and in part will be 
obvious from the description, or may be learned by the 
practice of the invention. The objects and advantages of the 
invention may be realized and obtained by means of the 
instruments and combinations particiilarly pointed out in the 
appended claims. 

To achieve the foregoing objects, and in accordance with 
the invention as embodied and broadly described herein, a 
method and apparatus for digitally watermarking digital data 
is presented which is visually imperceptible and strongly 
resistant to unauthorized detection and decoding. 
Furthermore, the watermarking technique of the present 
invention is robust to lossy compression and other image 
processing operations such as rescaling. The watermarking 
principle of the present invention is based on wavelet 
transforms where the coefficients of the filters have binary 
values, and thus are very attractive for practical realization. 
These wavelet filters are related to complimentary 
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polynomials, which are also related to multifilter banks. 
Experimental results have shown that multifilter banks, in 
addition to scalar filter banks, are advantageous for appli- 
cations such as that of the present invention. 

5 Those skilled in the art of digital signal processing 
appreciate that the number of applications that use digital 
storage and transmission is increasing at a rapid rate. Such 
applications include digital audio, images and video, trans- 
mission of video over pubUc networks (e.g., cable and 
telephone networks). Therefore, protection of these various 
forms of digital data are fundamental to securing certain 
rights, such as intellectual property rights, that enure to the 
benefit of the right holder. For example, pubUshers and 
artisans have long relied upon access control (i.e., physically 

J 5 controUing access) to provide security to their works. Sub- 
sequent techniques such as cryptography have provided 
limited protection against unauthorized reproduction by 
restricting those individuals that are authorized or retain the 
decryption algorithm for decrypting their artistic work. 

20 However, once the data is decrypted, it is freely copy able 
without a trace of information describing the origin of the 
casually protected data. To provide a tag or other identifying 
information, prior implementations have utilized a digital 
watermark which was perceptually significant and thereby 

25 degraded the aesthetic value of the digital data. Furthermore, 
attempts to place watermarks throughout digital data have 
often been destroyed by image processing techniques such 
as data compression operations. If a watermark is to be 
robust to lossy image processing operations, it may become 

3Q perceptually significant unless, as in the present invention, 
the digital watermark is spread across the digital data. 

Those skiEed in the art of digital signal processing 
appreciate the value of transforming spatial data into a 
transform domain, such as the frequency domain, in which 

35 signal processing operations may be performed. One popu- 
lar transform is the discreet cosine transform (DCT). While 
a DCT process could be employed for embedding a 
watermark, the primary disadvantage of the DCT is that it 
offers energy concentration, as opposed to energy spreading 

40 which is necessary for a robust method of embedding a 
durable watermark. Yet another transform technique appre- 
ciated by those of skill in the art is the wavelet transform 
which, however, also provides energy compaction and even 
more so than the DCT. Therefore, traditional or regular 

45 wavelets, the most prominent of which are the Daubechies 
wavelets, are less desirable choices for watermarking. Those 
of skill in the art appreciate that regular wavelets are 
continuous functions which implies that the impulse 
responses of the filers which tenerate them are relatively 

50 smooth. 

While it is not whoUy appreciated, there are other types of 
wavelets, such as non-regular wavelets or wavelets which do 
not provide continuous functions. Non-regular wavelets 
have completely contrasting physical properties from regu- 

55 lar wavelets. For example, they do not generate multireso- 
lution analysis and although the filter coefficients form 
orthogonal bases for the Hilbert space in the discrete-time 
case, non-regular wavelet functions do not form orthogonal 
bases for the Hilbert space of continuous-time functions. It 

60 is known that complimentary polynomials are intimately 
related to wavelets, and in fact, these complimentary poly- 
nomials are highly non-regular wavelets with coefficients 
having two values, 1 and -1. An additional embodiment of 
the present invention employs complimentary matrix poly- 

65 nomials which are related to multiwavelets. 

The present invention employs a suggested watermarking 
algorithm wherein the digital data or digital signal is parti- 
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tioned into blocks, which are not necessarily of the same 
length, but are partitioned such that the amplitude of the 
signal within a block does not change or vary significantly. 
A subsequent step of the watermarking algorithm of the 
present invention is to generate a subband tree that is either 
a pruned or a complete subband tree through which the 
wavelet transform may be performed. While a complete 
subband tree may be employed, additional security is 
derived by employing uniquely pruned subband trees. The 
forward orthogonal circular wavelet transform, or alterna- 
tively the multiwavelet transform, may be performed such 
that the filter coefficients have only two values, 1 and -1. 
Additionally, the polyphase components of the filters arc 
complimentary sequences. 

The next step of the watermarking algorithm is to insert 
the watermark by modulating some or all of the wavelet 
coefficients. Since the wavelets are highly non-regular, this 
is equivalent to placing the watermark everywhere in the 
frequency domain. The watermark itself may be a sequence 
of random numbers or it may be a predetermined sequence 
such as an ASCII text string. Both imperceptible and per- 
ceptible watermarks may be employed as long as the aes- 
thetic qualities of the digital data are not significantly 
impaired. Following the insertion or overlaying of the digital 
watermark, the inverse orthogonal circular wavelet trans- 
form is performed with the corresponding synthesis filter 
bank to obtain the watermarked digital data. The water- 
marked digital data may be compressed, transmitted, filtered 
or otherwise processed with the watermark remaining dis- 
cemable and intact. 

The algorithm for verifying whether unknown digital data 
incorporates a specific watermark may be performed by 
decomposing the digital data into blocks as was performed 
during the embedding process. Subsequently, the same sub- 
band tree as was utilized in the embedding processing, either 
a complete or pruned subband tree is reconstructed for the 
wavelet transform. A forward wavelet transform is per- 
formed on the unknown or distributed watermarked data to 
determine the wavelet coefficients. Likewise, a forward 
wavelet transform is performed on a previously stored copy 
of the original digital data, also known as the reference data, 
to determine the wavelet coefficients of the pristine or 
reference digital data. The wavelet coefficients of both of the 
forward transformed digital data (unknown data and refer- 
ence data) are compared to extract a difference which would 
be representative of any watermark data present within the 
unknown digital data. The extracted or corrupted difference 
sequence representing any resident watermark is compared 
with the watermark or reference watermaris stored previ- 
ously during the embedding process. If the extracted water- 
mark sequence is sufficiently close, (i.e. within a predefined 
verification threshold), such as if the extracted watermark 
sequence coincides with more than fifty percent of the 
reference watermark, then it is concluded that the watermark 
is present in the unknown data. If the watermark is a random 
sequence, compared with the reference watermark, then it is 
determined that either the digital watermark was not present 
in the unknown data or the unknown data was sufficiently 
corrupted to make the verification process statistically chal- 
lenging. 

The watermarking technique of the present inveotion is 
robust to unauthorized detection, even if an attacker knows 
the original image and watermarking principle, (i.e., even if 
the attacker knows that a wavelet transform has been used 
and the filter coefficients obtained form a complimentary 
sequences). To achieve success by an attacker, the attacker 
must find the exact number of filter coefficients and the exact 
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values of these coefficients. Since the number of different 
complimentary polynomials grows exponentially with their 
length, such an attack cannot be accomplished in a reason- 
able amount of time. Secondly, the attacker must also find 
the exact subband tree that has been employed. Any ran- 
domly pruned subband tree can be used in the watermarking 
process of the present invention. Thirdly, since there are 
even more complimentary matrix polynomials than scalar 
complimentary polynomials, one may use multiwavelet 
transforms to achieve an even higher level of security. 

Additional objects and advantages of the invention will be 
set forth in the description which follows, and in part wOl be 
obvious from the description, or may be learned by the 
practice of the invention. The objects and advantages of the 
invention may be realized and obtained by means of the 
instruments and combinations particularly pointed out in the 
appended claims. 

These and other objects and features of the present 
invention will become more fully apparent from the follow- 
ing description and appended claims or may be learned by 
the practice of the invention as set forth hereinafter. 

BRIEF DESCRIPTION OF THE DRAWINGS 

In order that the manner in which the above-recited and 
other advantages and objects of the invention are obtained, 
a more particular description of the invention briefly 
described above will be rendered by reference to specific 
embodiments thereof which are illustrated in the appended 
drawings. Understanding that these drawings depict only 
typical embodiments of the invention and are not therefore 
to be considered to be limiting of its scope, the invention will 
be described and explained with additional specificity and 
detail through the use of the accompanying drawings in 
which: 

FIG. 1 is a high level block diagram showing an example 
apparatus structure, employable by the embodiments of the 
present invention; 

FIG. 2 is a depiction of a two channel orthogonal FIR 
fiUer bank, in accordance with a preferred embodiment of 
the present invention; 

FIG. 3 is a high level block diagram of an embodiment for 
designating and determining the origin of digital data 
through the use of a digital watermark, in accordance with 
the embodiments of the present invention; 

FIG. 4 is a flow chart of the embedding process for 
embedding a digital watermark in digital data, in accordance 
with the embodiments of the present invention; 

FIG. 5 is a flow diart for verifying the presence of a 
digital watermark in unknown digital data, in accordance 
with the embodiments of the present invention; 

FIGS. 6-8 depict the frequency responses of three exem- 
plary filters depicting the non-regularity of the wavelet 
transform, in accordance with the embodiments of the 
present invention; 

FIG. 9 depicts a simplified flow diagram of digital data 
undergoing an embedding process for inserting a digital 
watermark on digital data, in accordance with the embodi- 
ments of the present invention; and 

FIG. 10 depicts a simpUfied diagram of a two-channel 
vector filter bank, in accordance with an embodiment of the 
present invention. 

DETAILED DESCRIPTION OF THE 
PREFERRED EMBODIMENTS 

The current invention embraces within its scope a method 
and apparatus for digitally watermarking digital data. Thus, 
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the descriptions of the preferred embodiments which follow The two signals exiting the analysis part, may be denoted 

should be read to include both methods and apparatuses. byYQ(z) and Yi(z) and called subband signals, and are equal 

With particular regard to the apparatuses involved, no par- to: 
ticular limitation is envisioned. Thus, the apparatus may 

involve dedicated hardware including discreet components, s Yo(z>-^Ho(z^X(z*^)+Ho(-z*^x(-z^]. (i) 
shift registers, custom VLSI chips, and the like, as well as 

general purpose computer or digital signal processing hard- Yi{z>*^4[Hi(z^x(z^Hi(-z*^)x(-z^]. (2) 

ware having a conventional arrangement including a pro- . , . . . • t <rr ^ - - 

cessing unit, memory, input devices, display devices, mass It is shown that the output signal, X(z) is given by 

storage devices, and the like. From the description which . , / s „ . ^^ / ^ r-.^ 

follows, those skilled in the art will recognize that a variety x(z)=vi[Ho(z)Go(z).H,(z)G,(z)pc(z). (3) 

of hardware and/or software configurations are suitable h[Ho(-z)Go(z)+h,(-z)Gi(z)]x(-z) (4) 
apparatuses for practicing the disclosed invention. 

By way of example, and not limitation, a suitable hard- In perfect- reconstruction (PR) filter banks, >^(z)=X(z) and 

ware apparatus is illustrated in FIG. 1. In FIG. 1, the therefore 
apparatus comprises processing means 18. Processing 

means 18 preferably comprises a general purpose micropro- Ho(z)Go(z)+Hi(z)Gi(z)=2. (5) 
cesser Uke those commonly used in personal computers or 
workstation computers. Processing means 18 could. 



Ho(-z)Go(z)+Hi(-z)Gi(z)-0. (6) 

however, also comprise a digital signal processor, a special- transform which represents the computation of the two 

ized processor custom tailored to the inventive method subband signals yo[n] and y,[n] from x[n] is caUed a forward 

disclosed herein, or any combmation of a general purpose ^^y^i^i transform. The transform which computes the signal 

microprocessor, a digital signal processor, and a specialized ^j-^j ^^^^^^ ^ ^^^^ ^[n] provided the filter bank is PR) 

processor. ^ called an inverse wavelet transform. Note that PR is very 

Electrically connected to processing means 18 is memory important even though the signals yo[n] and y^[n] arc often 

20. Memory 20 is preferably comprised of a combination of perturbed in a controlled fashion prior to reconstruction. The 

both volatile and non-volatile memory. Depending on the ^^^^ ^^^^^ deviation fi-om PR lies in the additional 

application, however, memory 20 may also comprise either processing of the subband signals. 

solely volatile or solely non-volatile memory. orthogonal filter banks, the impulse response ho[n], 
Processing means 18 is also electrically connected to 30 together with its integer, translates to form an orthogonal 
mass storage 22. Mass storage 22 preferably comprises a basis for the Hilbert space of square summable sequences, 
combination of fixed and removable computer disk storage xhe aperiodic auto-correlation function (ACF) of the 
(either magnetic or optical) although the apparatus could be impulse responses, ho[n] and hi[n], are half-band functions: 
configured with only fixed computer disk storage or remov- 
able disk storage. 35 <MnL holn+2k>=6i, (7) 

Computer usable medium having computer-readable code 

means embedded or encoded thereon is also contemplated. h,[n+2k]>«6^ (8) 

In such an article of manufacture, the computer readable .-i 1 • -j n 

oii 1 1 , c ' ^ while the cross-correlation is identically zero 
program code means will comprise various means tor imple- 
menting the method disclosed herein. By way of example, 40 tjn+2J£]>-o (9) 
and not limitation, suitable computer usable media include 

magnetic disks (both fixed and removable), optical, mag- two sequences ho[n] and hi{n] that satisfy (7), (8) and 

netic tape, volatile memory, non-volatile memory, and the (9) form an orthogonal two-channel FIR filter bank and the 

hke. In these articles of manufacture, the term "embedded two sequences can be used for signal expansion of square- 

therein*' should be read to include the various methods of 45 summable sequences. Ttc synthesis filters are completely 

encoding computer-readable program code means so they determined from the analysis filters: 
are contained on or in the computer usable media. 

Throughout this application, the invention is described in Go(z)-Hi(-z)-z-^Ho(z) (lo) 
relation to digital data. By way of example, and not 

hmitation, digital data include image data both fixed and 50 Go(z>.Hi(-z)=z- HiCz). (11) 
video, audio data, as well as other forms of digital data 

including textual data represented as an image. where the . operation means transposition conjugation of the 

The present invention employs digital signal processing coefficients and replacing z by z-\ The highpass filter is 

techniques for manipulating and processing the digital data ^^1^'^^ lowpass as 

of the present invention. The mathematical implementation ss 

of the processing techniques are first introduced followed by Hi(z)=z Ho(-z), (12) 

the specific methods employed by the present invention. For ^^^^^ ^ ^ ^^^^^ ^^^^ ^ necessarily odd. The 

digital signal processmg app^caUor^, two channel orthogo- ^^^^^^ ^j^^^ p^^^ ^ important 

nal fimte impulse response (FIR) filter banks are among the ^ ^ j r 

most widely used class of filter banks. FIG. 2 depicts a 60 

typical two channel orthogonal BR filter bank 30 which is ?i,yu,(.)0^z).H^.)H,(-z).m)W'' C") 

typically comprised of two parts. In a first part, an analysis ^ ' 

part is comprised of two filters, Ho(z) 32 and li,{z) 34, ^ necessary and sufficient condition for perfect- 

which are each followed by downsamplers 36 and 38, reconstruction is that P(z) is half-band: 

respectively. Filter bank 30 is further comprised of a syn- 65 

thesis or reconstruction portion comprising upsamplers 40 p(z)+p(-2)-2z'. (14) 
and 42 followed by two filters, Go(z) 44 and Gi(z) 46. 
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Splitting the even-indexed and odd-indexed coefficients is where the polynomial notation has been used: 
called a polyphase decomposition: 

t-i 

Ho(z)-Hoo(2>z-%i(z^, (15) >^ W = Z 

S 

H,(z)=H,,(z^2-*H,,(z^. (16) 



and 

10 Biz) = Yu^'^'^- 



From (12) the relationship between the polyphase compo- 
nents of the two filters can also be obtained. 

H,o(z)-z-<^-^>^Ho,(z), (17) 

Hii(z)=-2 ^ ^Hoo(z). (18) Polynomials of order N may be constructed with coefi&- 

, . . cients equal to 1 or -1, such that |P(z)| is minimal as z ranges 

WhJe those skiUed m the art appreciate that digital Alter is ^^^^ ^^^j^ ^^^j ^^^^ appreciate that 
banks were onginally developed m the 1970 s and 1980 s, coefficients to the pairs of polynomials are known as the 
with the main application of filter banks in the area of data R^ji^^hapiro polynomials or equivalently the Golay 
compression. Subband coding of audio, images and video, alternatively under a combined name known 
as the method is typically called, provides one of the Golay-Rudin-Shapiro (GRS) sequences, 
competing technologies for data compression and provides 20 ^^^^ appreciate that a Golay pair is 
several theoreUcal and practical advantages includmg mul- ^ ^^^^^j ^ j, ^ ^ ^ j^^^f^^ 
tiresoluuon analysis, interoperabiUty and fast and efEcient ^^^^ , ^^^.^^ 
computation Ihose slalled m the art also appreciate that I. from Golay pairs of shorter lengths. Kernels of lengths 2. 10 
Daubechies discovered that orthogonal filter banks provide 36 have been found by computer research and methods 
orthogonal bases for the Hilbert space of square-summable 25 ^^^^ ^y those of skill in the art, for employing these 
sequences and further demonstrated that when the filters ^^^^^^ constnict Golay pairs of lengths 2"10*26'. It is 
satisfy constramts m addition to perfect-reconstmction, e^gn^ unknown whether other kerneU exist. Those 
regular or smooth continuous-time functions (e.g scalmg ^^^^^ ^^ ^^^^y appreciate that while there are 
functions and wavelets,) may be obtained which are perfect-reconstmction FIR filter banks of every even length, 
orthogonal bases for the space of square-mtegrable func- 30 requirement that the length of the Golay sequences be 
tions. It should be pointed out that filter banks have been ^^^^ ^ sufficient. Furthermore, the question of the 
designed such that in addition to perfect recoostniction, the .^j^ j j,^, ^^^^ ^ j 
filters have acceptable and even good fiequency responses {j^gi^ed difficult problem. In addition to the requirement 
i.e., Ho(z) has always been required to be a reasonably good ^^^^^ j ^^^^^ j j^^j^^^^j ^^^^^ 
lowpass filter and U,(z) has also been required to be a 35 ^^j^^ ^jher conditions appreciated by Golay in his 
reasonably good highpass filter. Such a requirement of the ^^j.^^ research. Prior to the development of wavelet 
filter banks provides energy concentraUon leading to excep- transforms, it was appreciated and recognized that Golay 
tionaUy good compression capabiliUes. However wavelets, . ^^^^ orthonormal bases for the Hilbert space, 
which do weU for miage compression, also offer energy ^aditionaUy, complementary sequences have found various 
compacuon even more so than orthogonal tranrforms. 40 applications in wireless commuaication systems (e.g.. 
Therefore, those skilled in the art appreciate that Daubechies ^^j^^ ^^^^^ ^^^^ communication systems, 
wavelets, the most prominent orthogonal regular wavelets, ,j ^^^^ ^^^^^^ ^^^^^ ^^^j^ ^^^^^ sequences are a 
do not have the spread spectrtim c^ability, since they are of orthogonal FIR filter banks. Tliat is to say, the 
intended for image compression However, up un il this polynomial pairs are polyphase componenu of a 
point, the only l^pe of wavelets that were generally known 45 j j„ ^ orthogonal maximaUy-decimated two- 
were what wdl be <aUed "regular wavelets in which energy ^^^^^j ^^^^^ ^^^^ ^ ^e proved by 
compaction resulted. However, wavelet transforms that offer t^at given a filter H(z) of length 21-1 with 
energy spreading, such as "non-regular wavelets provide ^^^^^^ ^^ich are either +1 or -1, it must satisfy 
energy spreading and thus are very suitable tor digital 

watermarking. In the present invention, filter banks where 50 H(z)Ei(z~VH(-z)H(-z"^)«coiist=4l. (22) 
the filters Ho(z) and Hi(z) are not "good" filters in the 

traditional sense, (i.e., the corresponding filters of the It can be proved that the polyphase components of H(z) 

present invention display a pseudo -noise frequency response satisfy (21), i.e. they form a GRS polynomial pair: 
are employed). 

Ihe present invention employs the theory of Golay- 55 4KHo(z^)+z-*H,(z2)]lHo(z-2)«HiCz-^)] 

Rudin-Shapiro sequences, also known as compfimcntary +[Ho(r')+z-*HiCz^IHo(z-2)+zHi(z-^] 
sequences, which by definition consist of two finite 

sequences »2(Ho(z2)Ho(z-^+Hi(z^Hi(z-2)3. (23) 

A»(ao, aj, . . . , a,), (19) 60 Therefore, it is possible to establish that the filter with 

polyphase components equal to a GRS sequence pair is 

B-(bcu bl, . . . . bl), (20) power-complimentary. 

FIG. 3 depicts a general overview of the watermarking 

of I's and -I's such that the sum of autocorrelation func- process of the present invention. Digital data 50 is presented 

tions of the two sequences is constant: 65 to the present invention to undergo the watermarking pro- 
cess prior to distribution. As previously described, data 50 

A(z)AC2-^)+B(z)B(z-*)-2i, (21) may take the form of digital data capable of sustaining lossy 
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compression, such as audio, video, image and textual data 
represented as image data. 

Digital data 50 is presented to an embed watermark 
process 52 wherein a watermark 54 is embedded into data 50 
in such a manner that the watermark remains robust to lossy 
image processing operations. The embed watermark process 
52 is further detailed in FIG. 4. In FIG. 4, a step 56 partitions 
the digital data or signal into blocks which arc not neces- 
sarily required to be of the same length. The partitioning of 
the blocks is performed preferably such that the amplitude of 
the signal or data within the block does not dramatically 
vary. Step 56 may alternatively be omitted, but is useful for 
signals such as speech and audio. 

In a step 58, a subband tree is generated for the processing 
of data 50 in the wavelet domain. Those skilled in the art of 
wavelet processing appreciate the use of a subband tree 
which is comprised of bifurcating the original signal into a 
lowpass filter structure and a separate highpass filter struc- 
ture. Each of the highpass and lowpass filters are followed 
by downsamplers as described in FIG. 2. The present 
invention may operate on an entire or complete subband tree 
or, alternatively, may function equally as well using a pruned 
or partial subband tree. Additional security against an autho- 
rized attack may be accomplished by employing a randomly 
pruned subband tree whose random seleaion is repeatable 
during a verification process. The coeflScient for the filters 
are obtainable from the preceding equations, as compre- 
hended by those of skill in the art. 

The next step of embedding watermark process 52 is a 
step 60 which performs the forward wavelet transform od 
data 50. The present invention employs a forward orthogo- 
nal circular wavelet or multiwavelet transform where the 
filter coefficients consists of either a value of 1 or a value of 
-1. The polyphase components of the filters are complimen- 
tary sequences, as described above. The forward wavelet 
transform of the present invention employs an orthogonal 
FIR two-chaimel filter bank having filter coefficient values 
of either 1 or -1, while the polyphase components of the 
filters are complimentary sequences. It should be pointed out 
that while the filter bank theory has been developed assum- 
ing linear convolution, in practice circular convolution is 
used to avoid the increase in the number of samples. The 
corresponding wavelet transforms are called circular wave- 
let transforms. 

Referring back to FIG. 3, a watermark 54 is passed into 
embed watermark process 52. In FIG. 4, a step 62 inserts 
watermark 54 into the wavelet coefficients. The insertion 
process is implemented, in the preferred embodiment, by 
modulating all wavelet coefficients using bidirectional or 
unidirectional coding according to the predetermined binary 
sequence of watermark 54. In bidirectional coding, the 
coefficient is incremented to encode a "1^* and decremented 
to encode "0". In the unidirectional coding, the coefficient is 
left unchanged to encode a "0**. In the preferred embodiment 
of the present invention, a bidirectional coding scheme is 
employed which, assuming that there are equal numbers of 
I's and 0*s in the watermarking sequence, preserves the 
mean value of data 50. Those skilled in the art of signal 
processing appreciate that the present invention employs 
wavelets that are highly non-regular which results in the 
placing of watermark 54 spatially across the frequency 
domain. Furthermore, watermark 54 'may be implemented as 
a sequence of random numbers or may be implemented as a 
pre-detetmined sequence, such as an ASCII text string, or a 
combination such as an ASCII name of a business entity 
followed by a sequential identifier such as a particular serial 
number or user identification number. 
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In a step 64, the wavelet based watermarking algorithm of 
the present invention computes the inverse wavelet trans- 
form using the corresponding synthesis filter bank described 
above in equations corresponding to Go(z) and G^{z) as 

5 depicted in FIG. 2. As with the forward transform, the 
inverse transform of step 64 also employs an orthogonal 
circular wavelet transform. While the steps of generating a 
subband tree and performing forward and inverse wavelet 
transforms may be appreciated by those skilled in the art, the 

10 present invention employs specific non-compressive trans- 
forms that perform in nontraditional ways by providing 
non-regular responses for spreading the energy associated 
with data 50. Additionally, the present invention further 
obtains its success not only from the choice of the transform, 

15 but also from the specific filters that are employed. 

In FIG. 3, the watermarked data may be distributed in a 
step 66 through a communication channel or other channels 
to end users. While watermarked data may be directly 
distributed to end users or data consumers, finite limitations 

20 and practicalities of communication channel and storage 
medias frequently dictate that the data undergo compression 
or data reduction processes. FIG. 3 depicts one such com- 
pression process in lossy compression process 68. The term 
"lossy compression" describes compression techniques 

25 wherein data is reduced or encoded in such a manner as to 
make the reverse pix)cess incapable of reconstructing the 
original data in its entirety. Watermarked data that undergoes 
lossy compression process 68 and is thereafter subjected to 
pre-processing process 70 results in watermarked data that 

30 differs from the original watermarked data generated as a 
result of embedding the watermark in process 52. The nature 
of the watermarking process of the present invention is 
sufficiently robust to permit the watermarked digital data 
signal to be compressed, transmitted and even filtered. 

35 There are many applications envisioned in which the 
watermarking process provides substantial benefits. There 
are a number of technologies developed wherein protection 
fi-om illegal copying is deemed critical and even essential. 
While techniques such as encryption have been employed, 

40 encryption protects content during the transmission of the 
data from the sender to the receiver. However, upon receipt 
and decryption, the data in its unencrypted form is no longer 
protected from subsequent copying. Watermarks, however, 
compUment encryption by embedding a signal or watermark 

45 directly into the data. Such an application may provide 
control for applications such as copyright protection which 
may include the embedding of a serial number or other 
indicator within the data. Such embedded data facilitates the 
determination of the origin of the digital data. 

50 In order to perform verification process 72 as illustrated in 
FIG. 3, the present invention employs the storage of data 50 
as reference data 74 in a storage device 76. Reference data 
74 may be an exact copy of data 50 or may be an exact copy 
of a portion of data 50 when data 50 is comprised of a 

55 significant amount of data, such as in the case where data 50 
is video data. Verify watermarked data process 72 is detailed 
in FIG. 5. Verify watermark data process 72 commences 
with a comphmentary process of the embedding process by 
partitioning data into blocks in a step 78. Such a decompo- 

60 sition of the signal into blocks, not necessarily of the same 
length, may be performed such that the amplitude of the 
signal within a block does not change significantly. In a step 
80, the verification process generates a subband tree con- 
sistent with the embedding subband tree of the embedding 

65 watermark process 52. The subband tree may be imple- 
mented as a complete tree or a pmned tree, however, the 
subband tree must be consistent with the embedding sub- 
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band tree as subband trees having varying stages or pruned 
stages which result in erroneous verification transforms 
when inconsistent with the embedding process subband 
trees. When a pruned subband tree is employed, an algo- 
rithm or description of the pruned subband tree may also be 
stored in storage 76 (FIG, 3) with reference data 74 and 
watermark 90. 

A step 82 performs a forward wavelet transform of the 
distributed or unknown watermarked data using the same 
pair of analysis filters Ho(z) and Hj(z) that were used in the 
watermarking or embedding process of the distributed 
watermarked data. Watermarked data wavelet coefficients 
emerge from the transform process of step 82. 

In order to determine whether the watermark is present in 
the unknown distributed data, a copy or a portion of data 50 
stored as reference data 74 (FIG, 3) is utilized by step 84 
(FIG. 5) wherein a forward wavelet transform of the refer- 
ence data is performed. Like step 82, step 84 employs the 
same subband tree as generated in step 80 which corre- 
sponds to the subband tree employed during the embedding 
process. The transform process of step 84 results in refer- 
ence data wavelet coefficients. 

Step 86 compares the unknown or distributed water- 
marked wavelet coefficients generated in step 82 with the 
reference data wavelet coefficients from step 84. Compare 
coefficients differences step 86 compares the wavelet coef- 
ficients of the forward transform of the distributed water- 
marked data of step 82 with the wavelet coefficients result- 
ing from the forward transform of reference data in step 84, 
In the comparison step of comparing the wavelet coefficients 
of the reference data with the watermarked data, an attempt 
is made to extract the watermarking sequence or difference 
in the coefficients. 

A step 88 retrieves a reference watermark 90 (FIG. 3) 
stored within storage 76 earlier in the embedding process. 
The difference in the coefficients are compared against 
reference watermark 90 with statistical evaluation per- 
formed in a query task 92. If the differences between the 
extracted watermark and the reference watermark are within 
a defined verification threshold, then a step 94 denotes the 
detection of the watermark in the distributed watermarked 
data. 

When the difference in the coefficients do not acceptably 
compare with the reference watermark in query step 92, then 
a step 96 denotes that the watermark is insufficiently 
detected or absent in the unknown or distributed water- 
marked data. In the preferred embodiment, since lossy 
compression results in the decimation of certain bits, a 
portion of which may be watermarked data, if more than 
50% of the bits in the difference between both the coeffi- 
cients of the transform distributed watermarked data and the 
transformed reference data as compared with the reference 
watermark sequence are identified, then the conclusion is 
that the watermark is present in the unknown or distributed 
watermarked data. 

The embed watermarking and verification processes of 
the present invention are additionally robust to unauthorized 
detection, even if the supposed attacker knows of both the 
original data and the watermarking principle of the present 
invention, i.e., even if the attacker knows that a wavelet 
transform has been used and that the filter coefficients are 
obtained from GRS sequences. In such a scenario, to achieve 
success the attacker must find the exact number of filter 
coefficients and the exact values of these coefficients. That 
is to say, it can be shown that the total number of different 
orthogonal filter banks with binary coefficients of lengths 
N-4, 16, 20 is equal to 32, 192, and 128, respectively. If 



larger lengths of filter bank coefficients are used, the number 
of possible orthogonal filter banks increases and performing 
wavelet decompositions with all such possible combination 
becomes unrealistic. Additionally, the attacker must find the 
5 exact subband tree that has been employed. That is to say, 
any randomly pruned subband tree can be used in the 
watermarking process. Therefore, it is clear that the wavelet- 
based scheme of the present invention offers more flexibility 
and is more robust to an attack by unauthorized users, 
10 compared to the DCT-bascd approaches of the prior art. 
Yet another advantage of the present invention over 
previous watermarking techniques is the nimiber of bits or 
the length of a particular watermark, i.e., the number of bits 
that can be hidden in the data. In the present invention, the 
15 coefficients resulting from the wavelet transform are modu- 
lated by the watermark, thus, the size of the watermark is 
equal to the number of pixels in the data or image. In 
contrast, in a DCT transform, domain modulation of all 
transform-domain coefficients is not allowed since the 
watermark either will become visible or will loose the 
robustness for a modest loss in the quality of the data or 
signal. Therefore, it is clear that the number of bits that can 
be encoded in the wavelet-based approach of the present 
invention considerably exceeds the number of bits that can 
be encoded using a DCT approach. 

FIGS. 6, 7 and 8 depict experimental results for filters 
with 4, 20 and 52 coefficients, respectively. The coefficients 
employed were as foUows: 

HoMlA 1-0, 1.0,-1.0) 

Ho^°-(1.0, 1.0, 1.0, 1.0, -1,0, -1.0, 1.0, 1.0, -1.0, 1.0, 1.0, 1.0, 
-1.0, 1,0, -1.0, 1.0, 1.0, -1.0, 1.0, -1,0) 



20 



25 



35 



Ho^^=(1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, -1.0, -1.0, 1.0, 1.0, 1,0, 
1.0. -1.0, -1.0, -1.0, -1.0, 1.0, 1.0, -1.0, 1.0, 1.0. 1.0. -1.0, 
1.0. 1.0, 1.0, -1.0, 1.0, -1.0, 1.0, 1.0, -1.0, -1.0. 1.0, 1.0, 
-1.0, 1.0, -1.0, 1.0, -1.0, -1.0. 1.0. -1.0, 1.0, 1.0. -1.0, 1.0, 
-1,0. 1.0, -1.0 (24) 



Hie corresponding filters of Hi(z) which form a PR filter 
40 pair are not listed here but can be determined from the above 
equation (12). In the present invention, these filters have 
been chosen because they are considered to have short, 
medium and long impulse responses. It should be reiterated 
that the restriction that the coefficients be binary, that is to 
45 say either a 1 or -1, places severe constraints on the filters. 
Such filters achieve PR, but do not satisfy the additional 
constraints of multiresolulion analysis and smooth scaling 
functions of wavelets. Therefore, these filter banks are 
highly non-regular. Due to their non-regularity, these filters 
50 are inoperative for use in compression or data reduction 
techniques, however, for watermarking there behavior is 
very acceptable. The frequency responses of the three filters 
described in equation (24) arc depicted in FIGS. 6-8, 
respectively. 

55 A simplified graphical depiction is presented in FIG. 9 
corresponding to actual test results performed using the 
present invention. In FIG. 9, image 100 is subjected to the 
forward non-regular wavelet transform 60 (FIG. 4) for 
converting image 100 into the wavelet domain. Watermark 

60 54 is thereafter inserted through process 62 into wavelet 
domain image 102. Watermark 54, as described above, may 
take the form of an ASCII text string, and in the preferred 
embodiment is inserted or modulated into the coefficients on 
each row of the transformed image. Watermark 54 may 

65 optionally be repeated on every column, to the maximum 
extent possible such that every wavelet coefficient is modu- 
lated. It should be pointed out that only one iteration of the 
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JPEG Compression 
Factor 



% Correct Bits 



7.7 
9.46 
10.53 



73.4 

64 

53 



TABLE 2 



Percentage of correctly identified 
watermarking bits for a 64 x 64 image, 
compressed by XPEG, and a filter bank wiUi 20 
coefficients. 



JPEG Compression 
Factor 



% Correct Bits 



7.7 
9.46 
10.53 



73.4 
56.2 
51.5 



16 



wavelet transform is used. Therefore, watermark 54 is 
modulated at both high and low frequencies which causes 
the watermark to be robust during lossy image processing 
operations. Following the modulation of watermark 54 onto 
wavelet transform image 102, the inverse non-regular wave- 
let transform process 64 (FIG. 4) is performed resulting in 
watermarked image 106. 

In one experiment employing the present invention, the 
widely used image of "Lena" was processed. In evaluating 
the effectiveness of the present invention, the watermarked 
image was subjected to JPEG compression to evaluate the 
influence of the length of the impulse response. 

TABLE 1 

Percentage of concctly identified 
watermarking bits for a 64 x 64 image, compressed by 
JPEG, and a filter bank with S2 coefficients. 



and only when the image becomes significantly distorted 
from excessive image compression, docs the watermark 
become irretrievable. 

5 TABLE 4 

Perceatage of conccay identified 
watermarking bits for a 64 x 64 image and a filter bank 
10 with 4 cocfiBcicnts. The image is being subjected to 

decimation and interpolation. 



20 



25 



30 



35 



Compression Factor 


% Correct Bits 


10.24 


54.6 


18.20 


59.3 


40.96 


578 


113.78 


54 


163 


54 



TABLES 



Percentage of correctly identified 
watermarking bits for a 32 x 32 image ("Lena"), 

compressed by JPEG and a filter bank with 4 
coefScients. 



JPEG Compression 
Factor 



% Correct Bits 



30.50 
33.47 
54.04 
74.31 



82,2 
80.2 
58.5 
5Z3 



TABLE 3 



Percentage of correctly identified 
watermarking bits for a 64 x 64 image, compressed by 
JPEG, and a fllur bank with 4 coefficients. 



JPEG Cbmpression 




Factor 


% Cbrrect Bits 


7.64 


90.6 


9.43 


73.4 


10.90 


56.2 


11.49 


57 


12.31 


59 


13.91 


51 



An evaluation of the experimental results and the influ- 
ence of the length of the impulse response is depicted in 
Tables 1-3. Tables 1-3 demonstrate the robust natme of the 
watermarking method of the present invention to JPEG 
compression, which is a widely accepted image compression 
standard. It should be pointed out that longer filters or filters 
with a greater number of coefficients do not achieve better 
performance, in fact, results demonstrated that shorter filters 
achieved better performance, lliose skilled in the art of 
image processing appreciate that the JPEG compression 
algorithm provides perceptually lossless compression for 
modest values of the compression ratio, however, these 
values depend on the size of the image as well as the content 
of the image. From the resultant number of correct water- 
mark bits following image compression, it is apparent that 
the watennark algorithm is robust to image compression, 



Table 4 depicts the resiliency of the watermark method of 
the present invention to image resizing which is a very 
common image processing procedure. In the present 
example, the input image is filter by a lowpass filtered and 
downsampled. To identify the watermark, the downsampled 
image is interpolated to the original image size that was used 

45 when the watermark was embedded. Through such a 
process, even when a 64x64 image is decimated to a 5x5 
image, the watermarking algorithm of the present invention 
still retains a detectable watermark. Experimental evaluation 
has also found that a 32x32 image may be compressed using 
JPEG by a factor of up to 70 without destmction of the 
watermark. Such test results are depicted in Table 5. It 
should be pointed out that for JPEG compression by a factor 
of 70 results in server distortion of the image, and in fact the 

55 image becomes unrecognizable, however, the watermark 
embedded using the method of the present invention remains 
detectable in the obscured image. Furthermore, while the 
present invention was tested using an implementation of 
JPEG limiting the compression factor to 74, other evaluation 
techniques project that a watermark embedded using the 
techniques of the present invention may survive compres- 
sions by factors of up to or around 90. Due to the robust 
nature of the watermarking technique of the present 

65 invention, even images that contain texture which allow 
compression by large factors are likely to retain the water- 
mark even after substantial compression. 
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TABLE 6 



TABLE 9 



Percentage of correctly identified 
watennarkmg bits for a 256 x 256 image ("Lena") 
compressed by JFEG and a filter bank with 4 

coefficients. 



JPEG Compression 
Factor 



% Correct Bits 



5.23 
7.5 
11.3 
16.7 



55.9 
51.9 
51.1 
50.1 



Table 6 depicts tests results that are analogous to those 
depicted in Table 5, however, the results in Table 6 are for 
a 256x256 image. Therefore, it is possible to concluded that 
whatever size or composition an image or data may take, the 
watermark embedded using the present invention robustly 
withstands compression techniques that cause the data and 
primarily images to reach a level of being unrecognizable. 
Experimentation on the "Lena" image embedded with a 
watermark using the techniques of the present invention 
even after decimation by a factor of 20 in each direction, i.e., 
even when the 256x256 image is reduced to a 12x12 image, 
retained a recognizable watermark. 



TABLE? 



Percentage of correctly identified 
watermarking bits for a 256 x 256 image and a filer bank 
with 4 coefficients. The image is subject to shrinkage 
and zooming. 



JFEG Compression 
Factor 



% Correct Bits 



256 
441 
541 



5X63 
53.94 
46.6 



TABLES 



Percentage of correctly identified 
watennaiking bits for a 64 x 64 image, compressed by 

JPEG, using a Daubechies filter bank with 4 
coefficients. 



JPEG Compression 
Factor 



% Correct Bits 



7.7 
9.46 
1053 



65.5 
54.6 
54 
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Such results are summarized in Table 7. When comparing 
the results of Table 7 with the results of Table 4, it is evident 
that the watermarking technique of the present invention is 
more robust to image resizing in larger images than in 
smaller ones. Experimental results display that decimation 
of a 64x64 image by the same factor, led to an image size 
of 3x3, in which botL the image and the watermark became 
unrecognizable. 

Those skilled in the art of wavelet processing appreciate 
that regular wavelets are inherently smooth in their 
response. Furthermore, the most prominent family of 
smooth wavelets are the Daubechies wavelets. While 
smooth wavelets work well in applications such as subband 
coding, such smooth wavelets or regular wavelets do not 
perform weU for watermarking. 
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Percentage of correctly identified 
watermarking bits for a 64 x 64 image, using a 
Daubechies filter bank with 4 coefGcients. The image 
is subjected to shrinkage and zooming. 



Compiession Factor 



% Correct Bits 



10 



1.4 
1.5 



54.6 
4x.x(failure) 



Table 8 and 9 support experimentally the fact that such 
smooth or regular wavelets do not perform well for water- 
marking. In Table 8, it is daown that watermarking remains 
robust for JPEG compression, however, watermarking using 
a regular wavelet cannot survive lowpass filtering and 
decimation as depicted in Table 9. If a regular wavelet such 
as a Daubechies wavelet were employed for watermarking, 
a portion of the watermark would be placed in the low half 
of the frequencies with another portion of the watermark 
being placed in the high frequencies. JPEG compression 
operates by preserving the lowpass frequencies and some 
highpass components, thus for moderate compression ratios, 
more than half of the bits in the watermarking sequence can 
be retrieved. However, after lowpass filtering more than half 
of the watermark is lost. This result is due to the fact that the 
Daubechies wavelets do not have the "spread-spectrum 
capabilities'* of the non-regular wavelets of the present 
invention. The benefit of the present spread-spectrum based 
technique of the present invention is based on the fact that 
the watermark is embedded into the signal. In the present 
invention, it appears that the most prominent non-regular 
wavelet filters are those related to complimentary sequences. 

Multi-Filter Banks 

Filter banks and wavelets may be generalized as "multi- 
fiUer banks" and "multiwavelets" in which the filters have 
several inputs and outputs (e.g., multi-filters). For example, 
two-input two-output filters, for which the matrices have 
dimensions 2x2, whidi are here generally known as multi- 
filters, distinguishing them from a more typical single-input 
single-output filter or scalar filter. The concept of multi- 
wavelets is not a straight forward generalization of scalar 
45 fiUer banks and wavelets, since matrix multiplication is 
generally not commutative. 

In FIG. 10, a two -channel vector filter bank is depicted. 
The input signal vector X(z) is passed through a bank of two 
analysis multi -filters, Ho(z) and Hi(z). Following the pro- 
50 cessing of the multi-fiUers, each band is then downsampled 
by a factor of 2. At the receiver end, each band is initially 
upsampled by inserting a 0 between every two samples to 
restore the sampling rate. The output of the upsamplers are 
then passed through a bank of synthesis multi-fillers G^(z) 
and Gi(z). The resultant vectors are thereafter added 
together to form ^^(z), which is a replica of the original 
signal. It should be pointed out that the upsampling and 
downsampling operations are performed on every compo- 
nent of the vectors separately. The reconstructed signal is: 



60 



^=^CGo(z)HoCz)-G,(z)H,(z))X(z)+%CGo(z)Ho(-z)+ 
Gi(2)H,(z))X(-z) 



(25) 



To design PR vector filter bank, a solution must be found to 
the two equations: 
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(Go(z)Ho(z)+0,(z)Hi(z))-2I 
(Oo(z)Ha(-z)+Gi(z)Hi(-z))0 



(26) 
(27) 
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where the I and O are respectively the unit and zero matrices 
of appropriate dimensions, 
liie polyphase decomposition 



Ho(z)-HooCzVZ-'Hoi(z^) 



(28) 



In the present multi-filter implementation, orthogonal or 
paraunitary multi-filter banks are utilized in which the filters 
for an orthogonal set in 1^(Z): 



<ho(n). ho^(ti+2k)>-6j 
<hi(n), h/([n.2k)>=5j 
<hoCn). h/(tt+2]c>=0 



(29) 
(30) 
(31) 
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In paraunitary multifilter banks the synthesis filters are given 
by 

Go(z)=ft(,(2) (32) 
Gi(z)-Hi(z). (33) 

Note that in general the so-called flip construction 

Hi(z)-Ho(-z), (34) 
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Those skilled in the art of signal processing appreciate 
that several extensions of the GRS sequences have been 
proposed for applications such as radar and communication 
system processing, however, extensions to the matrix case 
have not been previously proposed. In the present embodi- 
ment of the present invention, a new generalization is 
advanced called "complementary matrix polynomials" or 
"matrix GRS sequences," wherein two matrix polynomials 
with coefficients 1 and -1 are called complementary if they 
satisfy the relationship. 



A(z)A''(2->B (z)B''(z-0-C, 



(35) 



where C is a constant matrix. 

More generally, C can be allowed to be a unimodular 
matrix and if such matrix polynomials occur in the diagonal, 
i.e. the diagonal components are GRS pairs, then they are 
presently appreciated by those of skill in the art. Therefore, 
the complimentary matrix polynomials contain all GRS 
pairs as a special case. Complimentary matrix polynomials 
are presently presented and were heretofore unlmown in the 
mathematical communication literature. However, because 
of the attractive properties of their matrix ACF, such com- 
plimentary matrix polynomials have inherent merits. For 
example, one advantage of complimentary polynomials is 
that the length constraint becomes relaxed. That is to say, 
while there are no scalar complimentary polynomials with 
three coefficients, there are pairs of complimentary matrix 
polynomials where one of the polynomials has three matrix 
coefficients. Furthermore, the question of the possible 
lengths of comphmentary matrix polynomials remains open 
for evaluation and is likely difficult to solve. By performing 
a search, it has been determined that the number of com- 
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the matrix extension of equation (12), does not work. It can 
be proven that in orthogonal multifilter banks the flip 
construction works if and only if Ho(z) is a normal matrix 
polynomial, i.e. if Ho(z) and Ho(z) are commutative [4]. In 
this embodiment of the present invention, multifilter banks 
in which Ho(z) is a normal matrix polynomial are employed 30 
and thus equation (34) works. 

Matrix GRS Sequences and Orthogonal Multifilter 
Banks 
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plimentary matrix polynomials considerably exceeds the 
number of scalar matrix polynomials. Such a discovery 
provides an additional advantage in enhancing the security 
of the watermarking process of the present invention. 

Another approach at evaluating complimentary matrix 
polynomials is from the point of view of a multifilter bank. 
Using such an approach, it is supposed that A(z) and B(z) are 
two complimentary matrix polynomials. Such a supposition 
then results in the fact that A(z) and B(z) are the first and 
second polyphase components of an orthogonal multifilter in 
a two-channel orthogonal FIR n multifilter bank. 

As described above, in the present embodiment of the 
present invention, commutative multifilter banks are 
employed. If a multifilter bank is not commutative, i.e. if we 
assume that Ho(z) has only binary coefficients but is not a 
normal matrix polynomial, then H^(z), which forms with 
Ho(z) a perfect-reconstruction multifilter pair, is not guar- 
anteed to have binary coefficients. Therefore, the design of 
non-commutative multifilter banks is much more difficult 
and remains, to a certain extent, an open problem. For the 
present invention, a preferred implementation for the present 
embodiment of embedding a watermark, the following 
perfect-reconstruction multifilter pair may be used: 



-(-1+2 + 2^- 
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H,(z)+Ho(-z). 

Commutativity follows from 

[b a kd c )~[d c Kb 



(36) 



(37) 



(38) 



The polyphase components of (36) are matrix complemen- 
tary polynomials 
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-(:::: 'r-').'-(-,'_r") 



(39) 



These multifilter banks are highly non-regular and smooth 
45 scahng functions and wavelets cannot be obtained. This 
property is imwelcomed in compression, but is highly desir- 
able in watermarking. 



50 



Watermarking Digital Images Using Multifilter 
Banks 



The actual methods for embedding a watermark using 
multifilter banks is, in principle, similar to the scalar 
wavelet-based algorithm. The primary difference between 
the embodiments is that multifilters in the present embodi- 

55 ment replace the scalar filters of the preferred embodiment. 
The input scalar signal must be split into two signals, e.g. by 
assigning half of the samples to the first signal and the other 
half of the samples to the second signal. While such an 
implementation may be accompUshed in several ways, the 

60 preferred and simplest approach is to partition the rows or 
columns into even and odd rows or columns or, alternatively, 
partitioning into the first half and the second half of rows or 
columns which results in a vector signal with two compo- 
nents. Tlie vector signal is thereupon subjeaed to a forward 

65 multiwavelet transform with the watermark being embedded 
using bidirectional coding. The inverse multiwavelet trans- 
form is thereafter performed to return the watermarked 
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vector signal. From the watermarked vector signal, a scalar 
signal is obtained in a way that is the reversal of the 
procedure with which a vector signal was obtained from the 
scalar signal above. The output scalar signal results in the 
desired watermarked version of the input scalar signal. 

Detection of the watermark signal embedded using mul- 
tifilter banks is again, in principle, performed according to 
the procedure described above relating to scalar transforms. 
The difference is primarily that prior to the forward wavelet 
transform, a scalar-to-vector transformation must be used 
that is exactly the same as the transformation used in the 
watermarking process. 

It should be pointed out that the present embodiment is 
additionally robust to unauthorized detection since the 
attacker must additionally discern or guess the scalar-to- 
vector transformation that has been used which are in 
addition to the requirements that the attacker must guess the 
coefficients of the multifilters and the particular form of the 
subband tree. Experimental results employing the present 
embodiment demonstrates that the multifilter bank-based 
technique is additionally more robust to compression and 
image resizing than the scalar filter bank technique. 

TABLE 10 

Percentage of conectly identified 
watermarking bits for a 128 x 128 image, subjected to 
JPEG compression. The watennarking algorithm ifi 
performed using a multifilter bank with 4 matrix 
coefEcients. 
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JPEG Coa^ressicn 
Factor 



% Correct Bits 



2,94 
4.50 
8.02 



57.8 

53.12 

53.12 



TABLE 11 



Percentage of correctly identified 
watermarking bits for a 128 x 128 image, subjected to 
shrinking and zooming. The watermarking algorithm is 

performed using a multifilter bank with 4 matrix 
coeSScients. 



JPEG Compression 
Factor 



% Correct Bits 



30 



35 



40 



45 



387 
541 



54.61 
50.66 



Table 10 demonstrates that even after JPEG compression by 50 
the maximum compression factor that can be achieved, the 
watermark embedded using the present invention is still 
detectable. (Note-as in the previous test results, the quality 
factor in the JPEG compression scheme was set to the 
minimum possible, i.e. the actual maximum compression 55 
ratio depends on the size of the image and the characteristics 
of the image.) Additionally, Table 11 depicts the results 
when a 256x256 image is subjected to shrinking and zoom- 
ing. By comparing Table 7 with Table 11, the improved 
performance of the multifilter bank embodiment becomes 60 
evident Such test data comparison demonstrates that using 
a scalar filter bank in the watermarking process accommo- 
dates the detection of the watermark for shrinking the 
256x256 image to a size of 12x12 for compression of 
approximately 441, while in the multifilter bank case, the 65 
same image can be shrunk to 11x11 while preserving the 
watermark. 



In conclusion, the present invention presents a novel 
method for watermarking digital images by employing 
wavelet transforms. While not all wavelet transforms are 
smtable for watermarking digital data, e.g. regular wavelets, 
noQ- regular filter banks have been disclosed wherein the 
filters employ binary coefficients. The mediod of the present 
invention provides a robust implementation for inserting a 
watermark and preventing unauthorized detection of the 
watermark. The watermark embedding process of the 
present invention embeds the watermark into the data allow- 
ing the watermark to be retrievable even if lossy signal 
processing operations are applied to the watermarked signal. 
The present invention ensures that the watermark is placed 
both at high and low firequencies thereby resulting in a 
strongly resilient watermark even after undergoing lossy 
compression and image resizing. Experimental results were 
also presented that support such an implementation. While 
digital data in the form of digital images were primarily 
described, the watermarking method of the present invention 
is applicable without modifications to all media types. 
Furthermore, the watermarking process of the present inven- 
tion is additionally suitable for multimedia data combining 
several fonms of media. Furthermore, implementing the 
present invention using filter coefficients aU of which arc 
either 1 or -1 provides additional attractiveness since pro- 
cessing and computation is drastically reduced. 

The present invention may be embodied in other specific 
forms without departing from its spirit or essential charac- 
teristics. The described embodiments are to be considered in 
all respects only as illustrative and not restrictive. The scope 
of the invention is, therefore, indicated by the appended 
claims rather than the foregoing description. All changes 
which come within the meaning and range of equivalency of 
the claims are to be embraced within their scope. 

What is claimed and desired to be secured by United 
States Letters Patent is: 

1. A method for watermarking digital data, comprising the 
steps of: 

a) forward transforming said digital data into transformed 
data using a non-regular wavelet transform having 
non-continuous functions; 

b) inserting a digital watermark throughout the entire 
frequency domain on said transformed data; and 

c) inverse U-ansforming said transformed data having said 
digital watermark embedded therein. 

2. The method for watermarking digital data as recited in 
claim 1, wherein said method further comprises the step of 
prior to said forward transforming step, partitioning said 
digital data into blocks such that the amplitude of said digital 
data within each block exhibits comparable magnitudes. 

3. The method for watermarking digital data as recited in 
claim 1, wherein said forward transforming step further 
comprises the step of generating a subband tree as a com- 
plete subband tree. 

4. The method for watermarking digital data as recited in 
claim 1, wherein said forward U-ansforming step further 
comprises the step of generating a subband tree that is 
pruned according to a predetermined pattern. 

5. The method for watermarking digital data as recited in 
claim 1, wherein said forward transforming said digital data 
into transformed data using a non-regular wavelet transform 
step, further comprises the step of selecting said non-regular 
wavelet transform as a orthogonal circular wavelet trans- 
form wherein filter coefficients are of the values of either 1 
or -1. 

6. The method for watermarking digital data as recited in 
claim 1, wherein said forward transforming said digital data 
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into transformed data using a non-regular wavelet transform 
step, further comprises the step of selecting said non-regular 
wavelet transform as a multiwavelet transform wherein filter 
coefficients are of the values of either 1 or -1. 

7. A method for designating and determining the origin of s 
digital data through the use of a digital watermark, com- 
prising the steps of: 

a) generating said digital watermark for uniquely desig- 
nating said origin of said digital data; 

b) embedding into said digital data said digital watermark jq 
throughout the entire frequency domain including the 
steps of: 

L forward transforming said digital data into trans- 
formed data using a non-regular wavelet transform 
having non-continuous functions; 

i. inserting said digital watermark on said transformed 
data; and 

i. inverse transforming said transformed data having 
said digital watermark embedded therein to form 
watermarked digital data such that said digital water- 
mark remains resilient to lossy compression of said '^^ 
watermarked digital data; and 

c) upon receipt of unknown digital data, processing said 
unknown digital data to verify said unknown digital 
data as being said watermarked digital data having said 
digital watermark embedded therein. 25 

8. Hie method for designating and determining the origin 
of digital data through the use of a digital watermark, as 
recited in claim 7, wherein said generating step further 
comprises the step of generating a predetermined pattern for 
use in pruning a subband tree for said non-regular wavelet 30 
transform. 

9. The method for designating and determining the origin 
of digital data through the use of a digital watermark, as 
recited in claim 7, wherein said forward transforming said 
digital data into transformed data using said non-regular 35 
wavelet transform step, further comprises the step of select- 
ing said non-regular wavelet transform as a orthogonal 
circular wavelet transform wherein filter coefficients are of 
the values of either 1 or -1. 

10. The method for designating and determining the 40 
origin of digital data through the use of a digital watermark, 

as recited in claim 7, wherein said forward transforming said 
digital data into transformed data using a non-regular wave- 
let transform step, further comprises the step of selecting 
said non-regular wavelet transform as a multiwavelet trans- 45 
form wherein filter coefficients are of the values of either 1 
or -1. 

11. The method for designating and determining the origin 
of digital data through the use of a digital watermark, as 
recited in claim 7, further comprising the step of following 50 
said embedding step, lossy compressing said watermarked 
digital data having said digital watermark embedded therein. 

12. The method for designating and determining the 
origin of digital data through the use of a digital watermark, 

as recited in claim 11, wherein said lossy compressing step 55 
comprises the step of lossy compressing using JPEG com- 
pression said watermarked digital data having said digital 
watermark embedded therein. 

13. A method for verifying the origin of digital data, 
comprising the steps of: 

a) spreading a frequency response of said digital data in 
a transform domain by forward transforming said digi- 
tal data with a non-regular circular wavelet transform 
having non-continuous functions to provide spreading 

of said digital data to form transformed digital data; 55 

b) modulating coefficients of said transformed digital data 
with a digital watermark throughout the entire fre- 



quency domain on said transformed data to fonm water- 
marked transformed digital data; 

c) despreading said frequency response of said water- 
marked transformed digital data to form watermarked 
digital data; and 

d) upon receipt of imknown digital data, determining if 
said unknown digital data has said digital watermark 
embedded therein. 

14. The method for verifying the origin of digital data, as 
recited in claim 13, wherein said modulating coefficients of 
said transformed digital data step comprises the step of 
inserting said digital watermark onto said coefficients of said 
transformed digital data. 

15. The method for verifying the origin of digital data, as 
recited in claim 13, wherein said spreading a frequency 
response step further comprises the step of generating a 
subband tree that is pruned according to a predetermined 
pattern. 

16. The method for verifying the origin of digital data, as 
recited in claim 13, fiirther comprising the step of storing for 
use in said determining step a copy of said digital data and 
a copy of said digital watermark. 

17. The method for verifying the origin of digital data, as 
recited in claim 16, wherein said determining if said 
unknown digital data has said digital watermark embedded 
therein step comprises the steps of: 

a) forward wavelet transforming said watermarked digital 
data to obtain watermarked digital data coefficients; 

b) forward wavelet transforming said copy of said digital 
data to obtain digital data coefficients; 

c) comparing a difference between said watermarked 
digital data coefficients and said digital data coefficients 
with said copy of said digital watermark; and 

d) when said difference as compared with said copy of 
said digital watermark is within a verification 
threshold, detecting said digital watermark within said 
unknown digital data. 

18. A computer-readable medium having computer- 
executable instructions for designating and determining the 
origin of digital data through the use of a digital watermark, 
said computer executable instructions for performing the 
steps of: 

a) generating said digital watermark for uniquely desig- 
nating said origin of said digital data; 

b) embedding into said digital data said digital watermark 
throughout the entire frequency domain including the 
steps of; 

i. forward transforming said digital data into trans- 
formed data using a non-regular wavelet transform 
having non-continuous functions; 

i. inserting said digital watermark on said transformed 
data; and 

i. inverse transforming said transformed data having 
said digital watermark embedded therein to form 
watermarked digital data such that said digital water- 
mark remains resilient to lossy compression of said 
watermarked digital data; and 

c) upon receipt of unknown digital data, processing said 
unknown digital data to verify said unknown digital 
data as being said watermarked digital data having said 
digital watermark embedded therein. 

19. The computer-readable medium having computer- 
executable instructions for designating and determining the 
origin of digital data through the use of a digital watermark, 
as recited in claim 18, wherein said computer-executable 
instructions for performing said generating step further 
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comprise computer-executable instructions for performing 
the step of generating a predetermined pattern for use in 
pruning a subband tree for said wavelet transform. 

20. The computer-readable medium having computer- 
executable instructions for designating and determining the s 
origin of digital data through the use of a digital watermark, 

as recited in claim 18, wherein said computer-executable 
instructions for forward transforming said digital data into 
transformed data using a non-regular wavelet transform 
step, further comprise computer-executable instructions for lo 
performing the step of selecting said non-regular wavelet 
transform as a orthogonal circular wavelet transform 
wherein filter coe£5cients are of the values of either 1 or -1 . 

21. The computer-readable medium having computer- 
executable instructions for designating and determining the 15 
origin of digital data through the use of a digital watermark, 

as recited in claim 18, wherein said computer-executable 
instructions for forward transforming said digital data into 
transformed data using a non-regular wavelet transform 
step, further comprise computer-executable instructions for 20 
performing the step of selecting said non-regular wavelet 
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transform as a multiwavelet transform wherein filter coef- 
ficients are of the values of either 1 or -1. 

22. The computer-readable medium having computer- 
executable instructions for designating and determining the 
origin of digital data through the use of a digital watermark, 
as recited in claim 18, wherein said computer-executable 
instructions further comprise computer-executable instruc- 
tions following said embedding step for performing the step 
of lossy compressing said watermarked digital data having 
said digital watermark embedded therein. 

23. The computer-readable medium having computer- 
executable instructions for designating and determining the 
origin of digital data through the use of a digital watermark, 
as recited m claim 22, wherein said computer-executable 
instructions for performing said lossy compressing step 
comprise computer-executable instructions for performing 
the step of lossy compressing using JPEG compression said 
watermarked digital data having said digital watermark 
embedded therein. 
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It is certified that error appears in the above- identified patent and that said Letters Patent is 
hereby corrected as shown below: 



Column 8, 

Line 52, before "operation" change to -- - 



Column 16, 

Line 47, change "watermarking" to - watermarking 
Column 18, 

Line 66, change the first "Hi" to -- Ho - 



Signed and Sealed this 
Twenty-sixth Day of November, 2002 



Attest: 




JAMES E. ROGAN 

A ttestin g Officer Director of th e United States Patent and Trademark Office 



01/05/2004, EAST Version: 1.4.1 



